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Abstract 

Objective. The objective of this study was to describe the involvement of patients or their representatives in quality management 
(QM) functions and to assess associations between levels of involvement and the implementation of patient-centred care strategies. 

Design. A cross-sectional, multilevel study design that surveyed quality managers and department heads and data from an organiza- 
tional audit. 

Setting. Randomly selected hospitals in — 74) from seven European countries (The Czech Republic, France, Germany, Poland, 
Portugal, Spain and Turkey). 

Participants. Hospital quality managers (« = 74) and heads of clinical departments (» = 262) in charge of four patient pathways (acute 
myocardial infarction, stroke, hip fracture and deliveries) participated in the data collection between May 201 1 and February 2012. 

Main Outcome Measures. Four items reflecting essential patient-centred care strategies based on an on-site hospital visit: (1) 
formal survey seeking views of patients and carers, (2) written policies on patients' rights, (3) patient information literature including 
guidelines and (4) fact sheets for post-discharge care. The main predictors were patient involvement in QM at the (i) hospital level 
and (ii) pathway level. 

Results. Current levels of involving patients and their representatives in QM functions in European hospitals are low at hospital 
level (mean score 1.6 on a scale of 0 to 5, SD 0.7), but even lower at departmental level (mean 0.6, SD 0.7). We did not detect asso- 
ciations between levels of involving patients and their representatives in QM functions and the implementation of patient-centred 
care strategies; however, the smallest hospitals were more likely to have implemented patient-centred care strategies. 

Conclusions. There is insufficient evidence that involving patients and their representatives in QM leads to estabUshing or imple- 
menting strategies and procedures that facilitate patient-centred care; however, lack of evidence should not be interpreted as evi- 
dence of no effect. 
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Background 

The role of involving patients in designing and assessing 
health care services has increased substantially over the last 
few years [1]. Approaches towards user involvement go back 
over decades, motivated mainly by ethical and governance con- 
cerns [2]. More recently, the patient safety movement has 
demonstrated the need to involve patients and learn from their 
experiences in order to ensure safe and high quality patient- 
centred care [3, 4]. The involvement of patients in designing 
and assessing their care is seen as a strategy to promote 
patient-centred care, acknowledged as an integral dimension of 
health care quality [4, 5]. This is highlighted in various recom- 
mendations of the high-profile inquiry into the quality and 
safety concerns at Mid-Staffordshire Foundation NHS Trust 
that specifically emphasizes the importance of patient repre- 
sentation and the prioritizing of patients' needs in the organ- 
ization and delivery of health care [6]. 

Patient involvement is referred to under different terms in 
the literature, including 'patient and public involvement', 'user 
involvement', 'lay involvement' or 'patient representation' [7]. 
We will focus here on the established term patient involvement 
to denote the involvement of patients or their representatives 
in activities related to planning, designing or assessing quality 
management (QM) in hospitals. The involvement of patients 
and their representatives in health care takes many forms, 
ranging from lay membership in managerial boards to involve- 
ment in condition-specific activities, such as services design, 
development of patient information material, identification of 
improvement priorities, or assessing and interpreting results of 
patient surveys. Hospitals recognized for their leadership in 
the field of patient-centred care involve patients or patient 
representatives in formal quality functions (such as setting 
standards or targets, and discussing results). 

Yet, the evidence base on the involvement of patients and 
patient representatives in quality functions is limited. For 
example, it has been demonstrated that patient involvement is 
frequently limited to the highest organizational level and not 
devolved to clinical units [8]. Moreover, it focuses mainly on 
the least technical issues of care (e.g. patient education) where 
patients can make constructive contributions; however, these 
contributions are not necessarily acted on subsequently [9]. 
Other studies exhibited that patient involvement is often pro- 
fessionally led and can be resource intensive and its gains are 
hard to identify [10]. One of the few studies to explore the re- 
lationship between hospital organizational characteristics and 
consumer involvement quantitatively detected only a low and 
non- significant correlation [11]. 

Given the dearth of research on the actual involvement of 
patients or their representatives in formal QM roles [1, 12] 
and the effect of such strategies on organizational policies and 
procedures [13], the aims of this study were (i) to describe the 
involvement of patients or their representatives in QM at hos- 
pital and at department (or pathway) levels and (ii) to investi- 
gate the effect of involvement on the implementation of 
strategies to improve patient-centredness of care in European 
hospitals. 



Methods 

Study design, setting and population 

This study was conducted as part of the 'Deepening our under- 
standing of quality improvement in Europe (DUQuE)' project, 
which was funded by the EU 7th Research Framework 
Program [14]. The overall aims and objectives of the project are 
described in detail elsewhere [15]. We employed a cross- 
sectional, multilevel study design in which patient-level measure- 
ments are nested in hospital departments, which are in turn 
nested in hospitals in seven EU countries. Hospitals were 
randomly selected from the participating countries: Czech 
Republic, France, Germany, Poland, Portugal, Spain and Turkey 
between May 201 1 and January 201 2. 

Each hospital nominated a coordinator (usually the quality 
manager) who attended training sessions on sampling proce- 
dures and data collection. Data collection included question- 
naires to professionals and patients, chart review, administrative 
data and an organizational audit. Full details of the field test are 
described elsewhere [15]. The data reported in this paper ema- 
nates from surveys to the hospital quality manager, heads of 
departments and an on-site audit on the implementation of 
patient-centred care strategies. For the audit, training sessions 
were carried out with independent surveyors in each country. 
The selection criteria for these surveyors differed slightly 
between country, but a general requirement was independence 
of the hospital setting undergoing audit and experience in ac- 
creditation visits to assess hospital quality and safety An IT 
platform was created to collect data from electronic surveys 
and the organizational audit. Responses rates were high (89% 
for professional questionnaires and 99% for the organizational 
audit). 

Conceptual framework 

We used a directed acyclic graph (DAG) to depict our knowl- 
edge and assumptions about the relationships under study and 
to guide our covariate selection for confounding control in the 
statistical analysis [16]. Although this study has a cross- 
sectional design, it is still useful to make the assumed and 
hypothesized relationships transparent with the visual aid of a 
DAG. The DAG in Fig. 1 reflects how patient involvement in 
QM at hospital and departmental levels can influence patient- 
centred care strategies. Hospital confounders (size, ownership 
and teaching status) potentially affect each of these measures. 

Outcomes, predictors and covariates 

The outcome variable is a score reflecting the implementation 
of essential patient-centred care strategies at the departmental 
level, measured through on-site visit for each of the four 
departments. This construct contains the following items: (a) a 
formal survey seeking views of patients and carers, (b) written 
policies on patients' rights, (c) patient information literature in- 
cluding guidelines and (d) fact sheets for post-discharge care. 
Each item is scored on a five-point scale (no or negligible com- 
pliance, low compliance, medium compliance, high-extensive 
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Figure I Directed acyclic graph for the relationships between 
patient involvement in QM at hospital and departmental levels 
and patient-centred care strategies. 



compliance and full compliance), with further instructions to 
account for the extent of implementation such as whether patient 
surveys had been fully documented and reported, whether 
patient education material had been designed in a non-technical 
language or whether evidence indicated an organization-wide im- 
plementation. The outcome measure was assessed by independ- 
ent hospital surveyors during an on-site hospital visit. This visit 
lasted on average 1.5 days and covered overall hospital organiza- 
tion and organizational procedures implemented in the four path- 
ways reported here. This outcome measure was developed based 
on a review of accreditation and quality standards, policy docu- 
ments and the literature and builds on previous research [17]. We 
acknowledge that patient-centeredness is a broader construct 
than reflected by these four items, as discussed in our own re- 
search [18, 19]. However, in the context of this study, our primary 
interest was to assess the implementation of patient-centred care 
strategies as stipulated in relevant policies on hospital QM 
systems. These aspects are most frequently covered by the chosen 
items. 

The key predictor variable is the score on the involvement 
of patients and their representatives in QM functions. This 
was measured for each hospital once at the hospital level and 
then again for each of the four departments. These constructs 
are based on a five-item scale that has been validated and used 
in previous research [17]. Items assess whether patients are 
involved in (i) the development of quality criteria/ standards/ 
protocols, (ii) the design/organization of processes, (iii) quality 
committees, (iv) quality improvement projects and (v) discus- 
sion of results of quality improvement projects. Each item is 
scored on a four-point scale including the categories never, 
sometimes, usually and always. The mean score of these four 
items is used in the associational analysis. Covariates include 
country and hospital level (size of the hospital, ownership and 
teaching status). 



Analysis 

The main hypothesis is that the involvement of patients and 
their representatives at hospital and/or departmental level 
is positively associated with essential patient-centred care 



strategies. This is based on the assumption that involving 
patients in designing and assessing care would lead to imple- 
mentation of policies to support patient views, rights and 
access to relevant patient information. We first present descrip- 
tive statistics on characteristics of hospitals participating in the 
study, and department-specific means and SDs for the main 
predictors and outcomes in our study. We also describe items 
that were aggregated to build the hospital- and department- 
level patient involvement and patient information constructs. 
Fisher's exact test or Pearson's % 2 statistics were used to deter- 
mine whether there were significant differences in these items 
across pathways, as appropriate. 

Covariate adjustments in our multilevel models were guided 
by the DAG shown in Fig. 1, which we assumed to be represen- 
tative of the data-generating mechanism. These models were 
restricted to complete observations for the predictor, outcome 
and all confounders in the analysis. Two separate sets of models 
were used to investigate (i) whether patient involvement in QM 
at the 'hospital' level was associated with patient-centred care 
strategies at the 'department' level and (ii) whether patient in- 
volvement at the 'department' level was associated with patient- 
centred care strategies. 

We used multivariate linear mixed models with a random 
intercept by country to account for clustering of hospitals 
within countries and adjusted for hospital size, ownership and 
teaching status. Models assessing the association between 
department-level patient involvement and patient- centred care 
strategies were further adjusted for hospital-level patient in- 
volvement, as this variable is a confounder in our DAG. All 
statistical analyses were carried out in SAS (version 9.3, SAS 
Institute Inc., NC, USA, 2011). 



Results 

Overall, 74 hospitals contributed data to be included in this 
study. The majority were public hospitals (79.7%) and about 
half (44.5%) were teaching hospitals. Larger hospitals with 
>500 beds accounted for more than half of the hospitals in 
the sample. A total of 72 of the 74 hospitals completed the 
hospital quality manager and head of department question- 
naires (Table 1). 

In Table 2, we provide descriptive statistics for predictor 
and outcome variables. The score for the predictor variable is 
much higher at hospital level, whereas scores for the involve- 
ment of patients and their representatives are universally lower 
across departments. The score of the outcome variable is 
highest for deliveries and lowest for hip fracture care. 

Details of the implementation of strategies to involve 
patients and their representatives in QM functions are pre- 
sented in Table Al. Patients and their representatives are rarely 
involved in developing quality criteria, designing/organizing 
processes of care, participating in quality committees or dis- 
cussing results of quality improvement projects. Somewhat 
more frequently, they are involved in the implementation of 
quality improvement projects. There was little variation in the 
observed involvement across departments. As shown in 
Table A2, slightly more than half of the departments fully 
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complied with having established formal surveys seeking the 
views of patients or carers and almost three-quarters had 
written policies on patients' rights in place. Roughly 38 and 
43%, respectively, were fully compliant with providing patient 
information literature and fact sheets for post-discharge care. 
The implementation of these strategies differed across path- 
ways for the latter two items, with child delivery care yielding 
higher responses for patient information (P = 0.054) and AMI 
care yielding higher responses for the implementation of post- 
discharge care (P — 0.033). 

Results from our multilevel models show that there is insuf- 
ficient evidence of an association between the involvement of 
patients and their representatives in QM functions at hospital 
level and the implementation of patient-centred care strategies 
in any of the four departments. We did not detect a relation- 
ship between patient-centred care strategies and type of hos- 
pital or hospital size (Table 3). 

A similar analysis was conducted to assess the relationship 
between departmental-level strategies for the involvement of 
patients and their representatives in QM function and the 
implementation of patient- centred care strategies. Again, our 



Table I Characteristics of hospitals participating in study 



Characteristic 


N 


% 


All Hospitals 


74 


100 


Czech Republic 


12 


16.2 


France 


11 


14.8 


Germany 


4 


5.4 


Poland 


12 


16.2 


Portugal 


11 


14.8 


Spain 


12 


16.2 


Turkey 


12 


16.2 


Teaching hospitals 


33 


44.5 


Public hospitals 


59 


79.7 


Approximate number of beds in hospital 






<200 


7 


9.4 


200-500 


22 


29.7 


501-1000 


31 


41.8 


>1000 


14 


18.9 


Completed hospital quality manager 


72 


97.3 


questionnaires 






Competed head of department questionnaires 


72 


97.3 



evidence did not support a relationship between either patient 
involvement or hospital-type and patient-centred care strat- 
egies in any of the pathways. However, we found that the smal- 
lest hospitals were more likely to implement patient-centred 
care strategies than larger hospitals (Table 4). This effect was 
observed for all pathways, with the exception of stroke care. 

Discussion 

We aimed to describe the involvement of patients in QM at 
hospital and at department level and to investigate the effect 
of levels of involvement on organizational policies and proce- 
dures to improve patient-centred care strategies in European 
hospitals. 

Levels of implementation of patient involvement 
and patient-centred care strategies 

Despite years of advocacy and policy support, the actual in- 
volvement of patients and their representatives in QM func- 
tions remains low in our study, in particular with regard to 
important domains such as establishing quality standards or 
organizing processes, for which evidence suggests that patients 
can make important contributions [20, 21]. The only domain 
where patients and their representatives appear to be involved 
to some extent is regarding the implementation of quality im- 
provement projects. This finding is consistent and observed 
both at hospital and departmental level. At departmental level, 
patient involvement is less frequent than at hospital level, and 
there is little variation across patient pathways. This is sup- 
ported by comparable studies suggesting that 'beyond board 
level, involvement of users, patients [. . .] and the general 
public is patchy and superficial.' [8]. Given that the ratings on 
the level of patient involvement are based on self-reports by 
managers; the actual level of involvement may be even lower in 
practice. Patient-centred care strategies are implemented some- 
what more heterogeneously, with pathways for deliveries yield- 
ing higher scores, although these differences do not reach 
statistical significance. The observed levels of implementation 
of key strategies to elicit and understand patient views and 
provide crucial information to patients are low Among the 
four assessed pathways, the deliveries and acute myocardial in- 
farction pathways report higher levels of implementation of 
patient-centred care strategies. 



Table 2 Descriptive statistics for patient involvement at hospital and departmental levels and patient- centred care strategies 



All conditions AMI Deliveries Hip fracture Stroke 

Mean(SD) Mean (SD) Mean (SD) Mean (SD) Mean (SD) 



Predictors 

Patient involvement in QM at 'hospital' level (0-5) 1.6 (0.7) 

Patient involvement in QM at 'departmental' level (0-5) 0.6 (0.7) 0.8 (0.7) 0.6 (0.8) 0.6 (0.6) 0.6 (0.7) 
Outcome 

Patient-centred care strategies (0-4) 2.8(0.9) 2.8(0.9) 3.0(0.9) 2.6(0.9) 2.8(0.9) 
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Table 3 Results of multivariable analysis for relationship of patient involvement in QM at the hospital level and patient-centred care strategies 2 



Patient-centred care strategies 





AMI (IV: 


= 69) 




Deliveries (IV = 69) 




Hip Fracture (N= 71) 




Stroke (IV 


= 71) 






b 


SE 


pr>|t| 


b 


SE 


pr>|t| 


b 


SE 


pr>|t| 


b 


SE 


pr>|t| 


Patients involved in 


0.19 


0.15 


0.211 


0.06 


0.14 


0.667 


0.04 


0.15 


0.784 


0.17 


0.15 


0.253 


QM at hospital level 
Teaching hospital 
Yes 


-0.08 


0.29 


0.793 


-0.05 


0.28 


0.847 


0.00 


0.28 


0.996 


0.26 


0.28 


0.354 


No 

Public hospital 
Yes 


0.19 


(reference) 
0.31 


0.539 


0.08 


(reference) 
0.29 


0.779 


0.11 


(reference) 
0.29 


0.696 


0.13 


(reference) 
0.29 


0.643 


No 
Hospital size 
<200 
200-500 


-0.38 


(reference) 

(reference) 
0.41 


0.359 


-0.69 


(reference) 

(reference) 
0.42 


0.106 


-0.20 


(reference) 

(reference) 
0.41 


0.631 


-0.63 


(reference) 

(reference) 
0.41 


0.127 


501-1000 


0.10 


0.42 


0.808 


-0.26 


0.43 


0.550 


0.00 


0.42 


0.995 


-0.23 


0.41 


0.583 


>1000 


0.15 


0.47 


0.757 


-0.08 


0.48 


0.876 


-0.39 


0.47 


0.415 


-0.32 


0.47 


0.502 



"Multivariate linear mixed models with a random intercept by country to account for clustering of hospitals within countries and adjusted for hospital size, ownership and teaching status. 



Table 4 Results of multivariate analysis of the relationship between patient involvement in QM at the department level and patient-centred care strategies" 



Patient-centred care strategies 





AMI (N ■■ 


= 48) 




Deliveries (N=58) 




Hip fracture (N= 57) 




Stroke (N 


= 64) 






b 


SE 


pr>|t| 


b 


SE 


pr>|t| 


b 


SE 


pr>|t| 


b 


SE 


pr>|t| 


Patients involved in QM at 


0.29 


0.18 


0.112 


0.03 


0.13 


0.833 


0.21 


0.19 


0.277 


-0.14 


0.18 


0.452 


departmental level 
Patients involved in QM 


0.15 


0.14 


0.299 


0.12 


0.15 


0.427 


0.02 


0.16 


0.913 


0.18 


0.15 


0.250 


at hospital level 
Teaching hospital 
Yes 


-0.36 


0.32 


0.267 


0.09 


0.23 


0.706 


-0.22 


0.33 


0.524 


0.15 


0.30 


0.630 


No 

Public hospital 
Yes 


0.15 


(reference) 
0.33 


0.646 


-0.01 


(reference) 
0.27 


0.972 


0.03 


(reference) 
0.30 


0.922 


0.30 


(reference) 
0.33 


0.367 


No 
Hospital size 
<200 
200-500 


-1.77 


(reference) 

(reference) 
0.52 


0.002 


-0.82 


(reference) 

(reference) 
0.38 


0.038 


-1.25 


(reference) 

(reference) 
0.61 


0.047 


-0.48 


(reference) 

(reference) 
0.47 


0.320 


501-1000 


-1.16 


0.52 


0.031 


-0.38 


0.37 


0.317 


-1.12 


0.62 


0.081 


-0.06 


0.48 


0.900 


>1000 


-1.05 


0.55 


0.062 


0.05 


0.43 


0.910 


-1.30 


0.64 


0.049 


-0.15 


0.52 


0.781 



"Multivariate linear mixed models with a random intercept by country to account for clustering of hospitals within countries and adjusted for hospital size, ownership, teaching status, and 'Patients 
involved in QM at hospital level'. 



Associations between patient involvement 
and patient-centred care strategies 

We hypothesized that higher involvement of patient and 
patient representative involvement would be associated with 
efforts to understand patient's views by conducting formal 
surveys, establishing written policies on patient's rights, produ- 
cing and providing patient information literature on the care 
pathway, and providing facts sheets for post-discharge care. 

We were not able to detect any significant association between 
levels of patient involvement and implementation of patient- 
centred care strategies. This might be interpreted in various 
ways. First, it is possible that we did not detect an association 
because hospitals had involved patients and their representatives 
only recently and sufficient time has not passed for their involve- 
ment to lead to establishing or implementing policies or proce- 
dures. Secondly, patient involvement may have some positive 
and measurable effects; however, they do not affect the policies 
and procedures investigated here. For example, Mockford et al. 
demonstrated that patient and public involvement has a range of 
impacts on health care services, in particular around information 
development and dissemination, including patient information 
brochures [1]. However, previous research studies have not dir- 
ectly assessed the relationship we examined in this study. 
Thirdly, involving patients and their representatives in QM func- 
tions might have no measurable effect on the policies and proce- 
dures investigated here. It is conceivable that some hospitals 
strive for patient involvement without providing the resources 
or commitment to translate this into changes in service organ- 
ization or delivery. In individual cases, a hospital might perform 
'lip service', rather than a service transformation function, as 
reported elsewhere [9]. This might be a particular issue if 
patients and their representatives are not properly selected or 
mentored to make a contribution. Recent research confirms this 
hypothesis and suggests that for patient involvement to be ef- 
fective, facilitators who can 'support, engage, navigate and advo- 
cate' for participation and influence are needed [22]. While 
examples from leading advocates of patient-centred care, such 
as the Dana Faber Institute and the Children's Hospital in 
Boston in the USA, provide evidence that patients make valu- 
able contributions to QM work, the success of patient involve- 
ment may depend largely on being able to recruit patients with 
the right experience and their ability to express their views con- 
structively [23]. The only effect observed in multivariate analysis 
was one of hospital size, where we detected an inverse relation- 
ship between levels of involvement of patients and their repre- 
sentatives in QM and the implementation of patient-centred 
care strategies. This might be explained by smaller hospitals 
being more community oriented than large teaching hospitals 
[24]. However, we did not detect a clear size gradient; thus, there 
might be other factors in the group of the smallest hospitals that 
explain higher implementation. 



Limitations 

Our study has a number of limitations. Some of the common 
limitations of the DUQuE study are referred to elsewhere [15]. 



Patient involvement in quality management 

Specific limitations of this study are the lack to control for 
temporality, i.e. the duration or history of involving patients or 
their representatives in QM functions, as it might be assumed 
that it takes some time from first involving patients and their 
representatives to establishing relevant policies and proce- 
dures. An added complexity is that seven countries participat- 
ing in the study might be at different stages on their journey to 
patient involvement. Ideally, it would have been desirable to 
highlight these rather than to adjust for the country effect in 
the multivariable analysis; however, the study was not designed 
to allow this. Another limitation is that we were not able to use 
information collected from hospital board members on the 
criteria for selection and training of patients and their repre- 
sentatives. This would have allowed illumination of the impact 
of these criteria on levels of involvement and strength of asso- 
ciation with patient-centred care strategies. However, as 
described by Secanell et al., the response rate to this particular 
questionnaire was poor [15]. The involvement of patients itself 
in designing this research would have been very desirable, 
ideally as a mixed-methods study, however, this was infeasible 
given the complexity of the project, timescales, multiple set- 
tings in multiple countries and resources available [18]. 
Another limitation is that we were not able to assess the 
factors that motivated hospitals to involve patients and their 
representatives in QM functions. Knowledge of these factors 
might inform further research on the impact of involving 
patients and their representatives in hospital QM functions. A 
final limitation is that in this study we were not able to assess 
the ability of the involved patients to exert influence on the 
decision-making process regarding the organization of hos- 
pital services. This is an issue that has been addressed in previ- 
ous studies, suggesting that levels of patient involvement that 
could be characterized as tokenism might be measurable with 
the scales used here but would not reflect the professionally 
led agenda for change and thus confound the relationship 
between involvement and outcomes [9, 10, 22, 25]. Given 
these limitations, the failure to detect statistically significant 
associations between patient involvement and the implementa- 
tion of strategies to improve patient-centeredness of care 
should not deflect from the general benefits of patient involve- 
ment [12] and should not be interpreted as evidence of no 
relationship. 

Conclusion 

Current levels of involving patients and their representatives 
in QM functions in European hospitals are low overall. It is 
slightly higher regarding hospital-wide activities as compared to 
departmental- specific functions and more frequent regarding 
specific projects than broader functions of planning and asses- 
sing results. We did not detect a relationship between levels of 
involving patients and their representatives in QM functions and 
the implementation of patient-centred care strategies. Further re- 
search should address the motivations and contextual factors 
for patient involvement in QM in greater detail. Currently, there 
is insufficient evidence to conclude that involving patients 
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and their representatives lead to establishing or implementing 
policies and procedures that facilitate patient-centred care; 
however, this lack of evidence should not be interpreted as evi- 
dence of no effect. 
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Table A I Patient involvement in planning for quality at hospital and departmental levels 
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Table A2 Patient- centred care strategies in four departments 
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*P-value for differences in items across pathways from Fisher's exact test. 
**P- value for differences in items across pathways from % 2 test. 



